character_converter
About
Turn Traditional Chinese script to Simplified Chinese script and vice-versa. Check string script to determine if string is Traditional or Simplified Chinese Characters.
This package also includes a largest first matching tokenizer.
Usage
extern crate character_converter;
use ;
let traditional_text = "歐洲";
let simplified_text = "欧洲";
// Check script
assert!;
assert!;
// Convert script
let result_three = traditional_to_simplified;
assert_eq!;
let result_four = simplified_to_traditional;
assert_eq!;
// Tokenize
let string = "好好学习天天向上.";
let tokens = vec!;
assert_eq!;
Benchmarks
Run benchmarks using the nightly bench feature:
cargo +nightly bench --features=bench